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ABSTRACT 

This document contains guidelines and support 
materials to assist potential purchasers of computer-based adult 
literacy (CBAL) systems as they consider which specific system to 
purchase. Included in the document are the following: guidelines and 
evaluation criteria (written in question form) pertaining to seven 
areas affecting the purchasing decision for a specific adult literacy 
program, a discussion of the best sources for obtaining tho 
information required to answer the questions, guidelines for using 
the evaluation criteria, and definitions of selected terms pertaining 
to CBAL systems. The evaluation cr i ter ia/ques t ions are organized 
under the following category headings: equipment; cost, installation, 
and licensing; compatibility with the adult literacy program; 
flexibility; management; documentation and support; and sources of 
further information about individual CBAL systems. A worksheet 
designed to be used in developing a purchasing recommendation is also 
included. Appended are a 22-itera annotated bibliography of 
publications about, the use of computers in adult literacy programs 
and CBAL systems and a chart cross-referencing items in the annotated 
resources with six integrated learning systems: Autoskill, CCC, 
Josten's INVEST, PALS (Principle of the Alphabet Literacy System), 
Pathfinder, and PLATO. (MN) 
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GUIDELINES 
FOR THE ACQUISITION OF 
COMPUTER-BASED ADULT LITERACY SYSTEMS 



The choice of software for literacy programs should be guided not only by the specific evaluative criteria. ..but 
also by the considerations which generally govern the use of other learning materials. (Audrey Thomas) 



Purpose of these guidelines: 

Deciding whether or not to introduce a computer-based system into an adult literacy 
program is a multi-faceted process. A wide range of issues need to be considered. These 
include pedagogical concerns: Does the approach used' by the technology support the 
educational goals and philosophy of the unit? What changes occur in classroom practices? 
What will be the effects on the learners? These include issues of cost: Is the expense 
(often very high) worth it? These include issues of support: If we run into trouble, who is 
there to help us? 

The guidelines which follow are intended to assist potential purchasers as they consider 
the acquisition of a computer-based adult literacy system. Seven areas which influence 
decision-making are identified, a series of questions pertaining to each area is presented, 
and, on the final page of the guidelines, a summary of the responses to each section is 
requested. For ease of reference, it is also recommended that the section below be 
completed. 



SYSTEM: 




EVALUATOR(S): 




DATE: 




FINAL RECOMMENDATION: Purchase 


Do NOT Purchase 
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Obtaining information with which to answer the questions: 

There are two broad areas for consideration when purchasing a system. These are the 
issues relating to the delivery system (e.g., type of computers, costs) and the issues of 
pedagogy (e.g., what can the system do? how well does it do it?) Questions dealing with 
the first area are normally answered in a factual way, i.e. to operate, this system requires 
computer X, with memory size Y. The vendor is usually the most reliable source of 
accurate information concerning these questions. 



For questions of pedagogy, however, it is usually best to ask people who are already 
using the materials for their reactions. This can include yourself! Ask the vendor if you can 
have the materials on a trial basis. This allows you to use the system with the staff and the 
students for whom it is intended. The appropriateness of the material for the relevant 
audience can then be assessed first-hand . As vendors, however, are sometimes reluctant to 
provide expensive systems for a trial run, the next best approach is to talk with learning 
centres and individuals who are using the material in which you are interested. (References 
to users of each system are provided in the Appendix. The vendor should also be able to 
provide you with a list of users.) In order to obtain a full picture of what a system has to 
offer, you should talk to those who have had successful, and unsuccessful, experiences with 
the materials. Given the large expenditure usually involved with the purchase of a system, 
the cost of several long distance phones calls is probably a good investment. 

When direct contact with users of the system is impossible, read evaluation reports of 
the system under consideration. While not as valuable as talking directly with someone 
familiar with the system, these reports usually address many of the issues of interest to 
purchasers. In particular, these reports frequently comment on the effectiveness of the 
system in a specific environment, and on long-term effects such as the retention of skills by 
the learner. (A list of sources lor such reports is found in the Appendix. The vendor should 
also be able to provide you with this type of information.) 

It may be possible, however, that you will be unable to follow any of the suggestions 
above. In that case, you should ask the vendor to provide you with answers to your 
questions. A word of caution, however...remember that the vendor's job is to SELL the 
system. Don't be blinded by the bells and whistles the system provides. Does the system 
meet your needs? Is the expenditure wor.h the returns? Could you spend the same amount 
of money, or less, in another way to get equivalent results? (Item 18 in the Appendix 
provides an interesting set of scenarios to use when working with a vendor.) 
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Using the criteria: 

Review all the questions in the guidelines first. This will acquaint you with the scope 
of the suggested questioning. Then decide which questions are significant for your situation. 
You can also consider the sections in any order. If, for example, you wish to address issues 
relating to content first, start with Section C, Compatibility with Program. 

It is strongly recommended that the instructors whose students will be using the 
materials participate in the evaluation process. Indeed, using an evaluation team consisting 
of various experts - curriculum developers, instructors, students, and computer specialists - 
- will probably result in a truly informed decision being made. 



Terminology: 

An Integrated Learning System (ILS) is an interconnection of computer hardware and 
software which offers instructional materials and programs to users within a sophisticated 
management framework. Typically, an ILS uses a network of computers or terminals to 
teach course content. This material covers a major portion of the mathematics/science and 
language arts/social science curricula, spanning several grades or levels. An ILS also 
monitors and reports student performance and, based on those findings, prescribes learning 
paths. 

When either the instructional or management function dominates, other terms are 
sometimes applied. Computer Assisted Instruction (CAI) refers to using the computer for 
teaching curricular content. Often rr: aterials labelled CAI cover a restricted curriculum area 
and grade level and use a drill and practice/tutorial delivery format. Computer-Managed 
Instruction (CMI) refers to using the computer for managing or tracking students' progress, 
often with the aid of on-line testing. The instructional materials, however, are not 
necessarily presented on the computer. Sometimes CMI also has the ability to recommend, 
based on student performance, a "further" set or sequence of instructional materials. 



These Guidelines are designed to reflect the full range of concerns associated with the 
purchase of an Integrated Learning System for instruction in the adult literacy field. 
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A* Equipment 

(This section refers to the specifications of the actual computer equipment needed to operate the integrated learning 
system effectively anu efficiently. It asks you to consider just how the hardware needs of the system can be met with 
your existing computers, if you have any, and what additional equipment you will need.) 

1. Can this system: 

a. be used on a single personal computer? 

b. be networked with other computers? (If YES, what additional memory is 
required?) 

2. What computer (and memory) is required to operate this system: 

a. at present? 

b. in projected releases? 

3. A variety of accessories (peripherals) are often associated with delivering computer- 
based literacy instruction. These include a speech card, a modem, a cd-rom, a video 
disk player, headphones, microphones, touch screen. For this system, which 
peripherals are: 

a. required? 

b. optional? 

c. provided? 



4. How do the requirements of this system fit with what we already have, i.e., can I use 
my current: 

a. computers? 

b. monitors (colour?) 

c. printers? 

d. keyboards? 

e. modems? 

f. space for equipment? 

g. print materials/books? 

h. other considerations? 



5. Can this system be used from a distant site: 

a. by students to access lessons? 

b. by instructors to access management systems? 

Record a summary of this section on the last page, keeping in mind the relevance of the 
information to your situation. 
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B. Cost f installing, and licensing 

(As is true with most major purchases, the costs depend upon how elaborate or how basic a system is required to meet 
your needs. This section is designed to help you determine the cost of the system you want and precisely what you will 
be getting for your money.) 



1. What is the total purchase price for a complete system? 



2. What is included in this price: 

a. disks? 

b. hardware? 

c. networking software? 

d. installation? 

e. shipping? 

f. initial training? 

g. on-going curriculum development sessions? 

h. printed materials required for printing and operation? 
L updated versions of print and computer based materials? 
j. maintenance (are various schedules available)? 
k. warranty (what is covered by this)? 
1. telephone/FAX (800) help-line? 
m. other features? 



i 

i 

i 
i 
i 

6 4. a. How many work-stations can this system support? 

b. What is the cost per work-station? 

■ c. In what way does the unit cost decrease v/hen multiple work-stations are 
purchased? 

■ 

■ 5. What discounts are possible: 

a. on the initial purchase? 
T| b. on future purchases? 



3. a. What is the cost of those items in question 2 which are not included in the 
purchase price? 
b. Are these costs one-time or on-going? 



6. What issues are associated with starting to use the system: 

a. once purchased, how long will it take to deliver the system? 

b. what are the layout/physical plant requirements? 

c. what are the electrical wiring requirements? 

d. what are the phone requirements, e.g., wiring, touch-tone? 

<tv I. o 
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e. how easy is the system to install? 

f. how long does it take to install the system? 

g. who is responsible for installation, e.g. the vendor, the manufacturer, the 
purchaser? 

h. what is the delivery time for the required print materials? 

i. how easy is it to enter preliminary student data in order for them to start 
using the system? 

j. how long does it take for instructors/aides/students to learn to use the 

system? 
k. other? 



7. What are the details of the licensing arrangements: 

a. what can be copied or transferred? 

b. is there a restriction on the number of stations that can be used 
simultaneously with the system? 

c. can the system be merged with other computer packages, e.g., word processing 
software, graphics software, spreadsheets? 

d. what are the other licensing arrangements? 

Record a summary of this section on the last page, keeping in mind the relevance of the 
information to your situation. 



C. Compatibility with program 

(Integrated Learning Systems are seldom used by adult educators as the exclusive mode of instruction. Normally, they 
are meant to supplement more traditional teaching. This section is designed to help you determine the degree to which 
the system fits with your beliefs and practices about teaching and learning.) 



1. How does the instructional content fit with our literacy program: 

a. What curriculum areas are included? 

b. Is the content relevant to our goals? (How well does it match?) 

c. This system is compatible with which principles of learning (e.g., whole 
language, phonics, outcomes based)? List some examples which support your 
answer to the previous question. 

d. What are the strong areas in the instructional content of the system? 

e. What are the weak areas in the instructional content of the system? 

f. Does the system serve as the dominant means of instruction or as an adjunct 
to the program? 

g. Does the learner use the system independently of the instructor/tutor? 



2. What skills for learning are developed by the system, e.g., predicting, summarizing, 
paraphrasing. 

u 
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3. Could the same teaching/learning objectives be met in other, more cost-effective and 
efficient, ways? 



4. What pre-requisite skills are required to use the system? 

a. reading levels of student? 

b. content skills? 

c. computer skills (e.g. keyboarding, familiarization with the system): 

(i) for the student? . 

(ii) for the instructor? 



5. Is the learning material: 

a. oriented towards adults? 

b. written in clear language? 

c. free from bias and stereotyping? 

d. culturally sensitive? 

e. Canadian content? 

f. of potential interest to your students? 



6. What support materials: 

a. are required? 

b. are provided with the system? 



7. What initial and on-going training of instructors is required? 



8. Does this system require a technical support person to be present while students are 
working on the computer? 



9. a. How long does it typically take a student to complete one lesson? 
b. Can the lesson be accommodated in our timetable? 



10. How can this material be used with our students who are physically challenged? 
(If special adaptive features are required, are they available?, included?) 

11. How can this material be used with our students who have learning disabilities? 
(If special adaptive features are required, are they available?, included?) 



12 
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12. a. Can this material be used with students whose first language is not English? 
b. In what languages other than English is this material available? 

Record a summary of this section on the last page, keeping in mind the relevance of the 
information to your situation. 



D. Flexibility 

(Adult educators regularly structure literacy programs to meet tbe needs of individual learners. This section is designed 
to help you determine just how flexible the computer-based system is likely to be so that your students 1 individual needs 
are accommodated.) 

1. Can the student alter the pace and sequence of the program, e.g., skip to a new topic 
if the current one is familiar, go to remedial material as needed? 



2. To what extent is the student's progress through the material directed by 

a. the instructor? 

b. the student? 

c. the system? 

3. a. Can the instructor change existing content and/or add content? 

b. If yes, how easily can this be done, (e.g., time required, technical skills required)? 

c. Can the instructor change or add tests/evaluations? 

d. If yes, how easily can this be done, (e.g., time required, technical skills required)? 

e. Can the instructor regulate parameters, e.g., percentage correct needed for 
mastery, number of chances to answer correctly? 



4. Can adaptations be made to: 

a. print size on screen? 

b. audio (e.g., turn sound off, change voice)? 

c. other features? 



5. How does the learner enter/re-enter the program (e.g., same place each time, select 
own starting point, computer controlled, instructor controlled)? 

Record a summary of this section on the last page, keeping in mind the relevance of the 
information to your situation. 
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E. Management 

(Integrated Learning Systems ordinarily allow the instructor to monitor, record, and report student progress. This section 
is intended to help you determine these and other types of management potential available with the systsm.) 

1. Does the system: 

a. accept correct answers in a variety of forms? 

b. give students a reasonable number of chances to answer correctly? 

c. provide useful help where appropriate? 

d. re-teach the lesson in another way if the student answers incorrectly several 
times? 



2. Are the responses students receive for their work appropriate (e.g., positive, adult, 
immediate, constructive, not boring, not annoying) when: 

a. on-screen? 

b. aural? 

c. printed-out? 

3. Will the computer-based activities provide our students sufficient opportunity to 
practice the skill or concept to ensure a reasonable chance for success? 

4. a. How does the system evaluate a student's success/progress with the material? 

b. Are the criteria used for success appropriate *or our students? 

c. Can the criteria be modified by the instructor (e.g., pass rate changed from 75% 
to 85%)? 

5. Are useful diagnostic evaluations provided where appropriate: 

a. to students? 

b. to instructors? 



■ 6. Can students print a copy of their work? 

i 



i 



7. What information on test performance (e.g., scores, number of problems attempted) 
is provided/available: 

a. to students? 

b. to instructors? 



° 14 
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8. When/where is information on test performance provided (e.g., on screen at end of 
test session, stored for future retrieval)? 

9. Does the system provide information on "time" variables, e.g., time a student spends 
per computer session, time it takes to complete a unit, etc.? 

10. What security features exist, e.g, back-up systems, limited access to records, 
protection against 'infected' programs? 



Record a'summaiy of this section on the last page, keeping in mind the relevance of the 
information to your situation* 



F. Documentation and Supp ort 

^Materials designed to enable you to deal with the operational aspects are typically available with Integrated Learning 
Systems. This section alerts you to questions that will help you determine the nature and extent of support documents 
and services.) 

1. a. What kind of documentation is provided for the students ' use? 

b. Is it easily understood? 

c. Is it comprehensive? 



2. a. What is the nature and quality of the documentation provided for the instructor's 
use? 

b. Is it easily understood? 

c. Is it comprehensive? 



3. What supports does the vendor offer after installation? 



4. Is there a (24 hour toll-free) telephone/FAX help line? 



5. What new features (including updates) are being considered for the system? 



6. If there are new features, will the vendor supply these free of charge? 




15 
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7. If there is a "user-group" for this system, how do I contact it? 

Record a summary of this section on the last page, keeping in mind the relevance of the 
information to your situation. 



G. Further information 

(Issues concerning "in-course"and long-term evaluations of the system and the reliability of the developer and distributer 
of the system are addressed in this fiual section.) 

1. What do reviews and field testing evaluations say about this system? (e.g., ease of 
use, target group, retention of learning, transferability of skills, student attitudes)? 



2. Who else in the region is using this system? 

3. Who developed the instructional materials? 

4. How reputable is the manufacturer (e.g., well known for educational materials); 

5. How reputable is the distributor (e.g., prompt and helpful?) 



lb 
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Purchasing Recommendation 



RATING: This can be done through a text summary and /or by numerical weightings. If relative weightings are 
given to each section of the Guidelines, each user should determine these by taking into consideration 
his or her unique situation. For example, if you have access to several highly competent computer 
technicians, the external support available may not be a crucial factor in making your decision; 
whereas, if such technicians are not available locally, support service might take on a higher 
weighting. In any event, the Guidelines consist of inter-dependent parts, and the weighting given to 
each will have to be determined by individual organizations. 



A. EQUIPMENT 



B. COST, INSTALLING, AND LICENSING 



C. COMPATIBILITY WITH PROGRAM 



D. FLEXIBILITY 



E. MANAGEMENT 



F. DOCUMENTATION AND SUPPORT 



G. FURTHER INFORMATION 

FIN-iL RECOMMENDATION: Purchase 
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APPENDIX 



This appendix contains two interrelated sections. The first section Is a an annotated 
bibliography. The items listed range from position papers on the use cf computers in the 
adult literacy field, to descriptions and evaluations of Integrated Learning Systems. The 
second section cross-references items in the annotated resources, by number, with six 
Integrated Learning Systems. 
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ANNOTATED BIBLIOGRAPHY 



1. A Comparison of Computer Assisted Instruction Systems . Career Development and 
Employment, Alberta, 16 pages, 1992 

This report provides, in paragraph and chart form, descriptions and 
comparisons of the PLATO, Pathfinder, Josten's Invest, CCC, and Wicat 
systems. For each system, a wide range of issues is addressed, including the 
curriculum covered by the system, training and support requirements, 
hardware requirements, and costs. 

2. An Evaluation of the Pathfinder Learning System. Department of Advanced Education 
and Training, P.O. Box 6000, 416 York Street, Fredericton, N.B., E3B 5H1, 1990. 

An investigation of the use of the Pathfinder Learning System at the New 
Brunswick Training Centre is presented. 



3. Askov, Eunice and Clark, Cindy Jo, "Using Computers in Adult Literacy Instruction", 
Journal of Reading , pages 434 - 448, March 1991. 

After briefly setting an overview for the use of computers in adult literacy, 
over 100 "floppy" disk are reviewed. Content and skills, iastruction methods, 
and system requirements are addressed. In addition, a list of software 
publishers/distributors (in the United States) is provided. 



4. Cummins, Patrick, The Learning Centre: Adult basic education using computers. The 
Learning Centre, Ottawa Board of Education. Vol. 1, 64 pages, Vol 2, 108 pages, 1990. 

This two volume report provides a detailed account/analysis of the use of 
computers in the provision of basic literacy and numeracy instruction at this 
site. It looks at a wide range of issues, e.g., "learning to use computers", 
"retention", and "math accomplishments". The project used Macintosh, Apple 
II GS, and Icon machines with applications software, educational games, and 
drill and practise programs (the latter delivered using Autoskill). 



13 



Guidelines and Support Materials for the Acquisition 
of Computer-Based Adult Literacy Systems 



Page 16 



5. Eggleston, Bryan, Computer Managed and Compute r Assisted Learning Systems, 
Innovations Program, Canada Employment and Immigration, B.C./Yukon Regional 
Field Office, 10 pages, 1990. 

After providing a brief rationale for using computer-based instruction with 
adults, the document describes and compares four integrated learning 
systems: Pathfinder, CCC, PALS, and PLATO. 




6. Friesen, Valiory Randall, A Critique of Computer Managed Instruction i n the Light of 
Key Principles of Adult Education , unpublished Master's of Arts thesis, Simon Fraser 
University, 100 pages, 1991. 

Stemming from the authors experience with students in a learning centre for 
Native Indian adults, this report seeks "the goals, principles and strategies 
reflected in current emphases in adult education, and to critique, in the light 
of those values, the adequacy of CMI (as exemplified by Pathfinder) as an 
adult learning system.' (pg 2) 



7. Literacy Works, Saskatchewan 7 literacy Network (newsletter), Vol 1, No. 2, P.O. Box 
1520, Saskatoon, SK S7K 3R5, 23 pages, June 1990. 

This journal volume included reports from literacy instructors using PALS 
and PLATO, reviews of several inexpensive computer programs which might 
be used in literacy programs, and general technology based information such 
as parts of the microcomputer, a glossary and reference materials. 



8. Levin, Benjamin, A Study of Computer-Based Employment Skill Upgrading Programs , 
available from Mark Foley, Employability Improvement, Employment Policies, Human 
Resource and Labour Canada, 140 Promenade du Portage, Phase IV, 4th Floor, Hull, 
Quebec K1A 0J9, 1994. 

This study presents a comprehensive descriptions of five systems (Autoskill, 
PLATO, CCC, Pathfinder and Josten's INVEST). It addresses, mainly in chart 
form, topics such as potential clients of the system, content, staffing, current 
uses, evaluation. 



o 
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9. PALS/Pathfind, r Project Literacy Division, Nova Scotia Department of Advanced 
Education and Job Training, P.O. Box 2086, Station "M", Halifax, N.S., B3J 3B7, 13 
pages, 1990. 

This document reports the findings of a pilot project which included among its 
objectives (a) determining whether or not PALS is a suitable prerequisite for 
Pathfinder, (b) determining if both systems can be used in tandem, (c) 
determining if the Pathfinder curriculum is sufficient for incoming adults in a 
community college program, (d) determining how motivational both systems are 
for adults and (e) determining the role of the instructor in delivering the 
PALS/Pathfinder system. The pilot was carried out with 47 subjects. The only 
requirements for students entering the PALS segment were that their reading 
level be LESS than sixth grade level and that they be of normal intelligence. The 
students in the Pathfinder component entered with reading levels above the 
fourth grade level. Brief reviews of the CCC and PLATO systems are also 
include. 



10. Pathfinder System . Youth Employment Skills Canada. Inc. . Advanced Education and 
Training, P.O. Box 6000, 416 York Street, Fredericton, N.B., E3B 5H1, 6 pages, 
undated. 

This paper presents an overview of the Pathfinder system, then identifies 
benefits and liabilities, particularly as these , relate to the New Brunswick 
"environment". 



11. Position Paper: The Use of computers in Adult Literacy and Software Evaluation . 
Computers in Literacy Committee of the Metro Toronto Movement for Literacy, 9 St. 
Joseph St., Suite 302, Toronto, Ontario M4Y 1J6., 20 pages, 1990. 

This document provides thoughtful commentary on using the computer as 
TOOL in adult literacy education. Also included are reviews of seventy-five 
(75) stand-alone pieces of software, listing of organizations which provide 
information on software, and additional sources of evaluation guides and 
reviews, including on-line data bases. 
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12. Report on the Pathfinder Learning System, the Learning Centre. Ottawa Board of 
Education, 3 pages, 1991 

Based on the use of the system with 68 students, this brief (non-statistical) 
report provides commentary on the use of Pathfinder with adult learners. 
The validity of the tests provided with each unit, teacher input into student's 
lessons, and the validity and transferability of the skill building exercises are 
among the highlighted pedagogical issues. 



13. Results of the Evaluation of Autoskill Software , Department of Advanced Education 
' and Labour Program Coordination and Apprenticeship Training, P.O. Box 6000, 416 
York Street, Fredericton, N.B., E3B 5H1, 16 pages, 1993. 

This study evaluated (1) the "auricular fit" between the Autoskill software 
and the curriculum in the Adult Learning Centre in Saint John, (2) the rate 
and level of participant progress, and (3) student and teacher attitudes 
toward Autoskill software, Subjects ranged in age from 15 to 23 years. Test 
instruments were the Canadian Adult Achievement Test (Level A) and an 
attitudinal survey. 



14. Results of the Longitudinal Evaluation of the CCC Instructioi b1 System .Program 
Coordination and Apprenticeship Training Branch Advanced Education and Training, 
P.O. Box 6000, 416 York Street, Fredericton N.B. E3B 5H1, 30 pages, 1992. 

This document presents the results of a year long study designed to evaluate the use 
and effect of the CCC system at eight community college sites. The areas of 
investigation were (1) the rate and level of student progress with the CCC 
Instructional System, (2) the generalization of skills learned on the CCC System to 
other contexts, (3) the applicability of the CCC Instructional System to the Basic 
Academic Upgrading (BAU) and Intermediate Academic Upgrading (IAU) 
programs, (4) student and teacher attitudes toward the CCC Instructional System, 
(5) use of the CCC Instructional System in the eight sites and (6) use of the system 
with remedial students from other programs who are referred to the system. 



15. Sadler, Stride Program: Final Report . Unpublished. Available from Columbia 
Institute of Canada, Calgary, 1990. 

This report describes a pilot project using CCC with Natives in a Calgary 
program. Included are anecdotal comments on student progress, information 
on academic gains, and a description of the program and its components. 
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16. Sawyer, Don, "Pathfinder, Look Before You Leap!" Native Adult Education 
Newsletter , pg 8 - 10, October, 1991. 

Commentary on experiences using the Pathfinder system, in particular within 
a Native community, is provided. 



17. Sylvestre, Ken and Lewis, Joanne, Computer Assisted Learning Systems. Evaluation 
Report . Sorrento Systems, 212 Hawkins Street, Whitehorse, Yukon, Y1A 1X4, 65 pages, 
1993. 

This evaluation provides: a perspective on adult literacy needs in Yukon, an 
evaluation of the capabilities of various Integrated Learning Systems in 
meeting those needs (Autoskill, CCC, I Can Read, INVEST, PLATO), 
recommendations of the ILS options which would be most effective in 
Yukon, given present budgetary constraints and other considerations, 
alternatives to ILSs and an overview of the use of ILSs in Yukon and in the 
rest of Canada. 



18. Technology Enhanced Learning Project. Proposal Assessment - Phase 2 T Literacy 
Section, Department of Education, P.O. Box 2086, Station "M", Halifax, NS. B3J 3B7. 
1993. 

Using a set of scenarios, this document presents questions to ask vendors when they 
are demonstrating an ILS. For example, when considering the content component 
of a system, a brief description of "Marie, a 43 year-old Micmac woman...functioning 
at Level Two of the Academic Upgrading Program...(and having) problems with 
subject-verb agreements, and sentence structure" is presented. Questions for the 
vendor, designed to reflect how the system can meet this student's needs, are then 
offered. A 9 page evaluation form to assist with purchasing decisions is also 
included. 



19. Thomas, Audrey, Literature Review , Computer Software for Literacy Project, Canadian 
Education Association, 34 pages, 1990. 

This document (1) examines the concept of literacy, (2) explores the use of 
technology in literacy instruction, and (3) presents an overview of the findings 
from Canadian and American evaluations of the use of integrated learning 
systems. The Canadian evaluations discuss the effectiveness of CCC, PALS 
(used in conjunction with the Pathfinder management system), and PLATO. 
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20. Thomas, Audrey M. and Buck, Martin, Analysis of I ntegrated Learning Systems and 
Their Use in Adult Basic Education Programs in British Columbia. Open Learning 
Agency, Marketing Department (Provincial Curriculum Publications) 4355 Mathissi 
Place, Burnaby, B.C. V5G 4S8, 1994. 

The study provides a descriptive analysis of six systems (Autoskill, CCC, 
Josten's INVEST, PALS, Pathfinder and PLATO) and how they are being 
used by instructors in adult basic education programs in the province of 
British Columbia. Instructors and students in colleges and school districts 
across the province were visited and interviewed for their opinions about 
each of the systems. 



21. Wellburn, Elizabeth, Current Issues Regarding Integrated L earning Systems. Education 
Technology Centre of British Columbia, P.O. Box 2040 Sidney, British Columbia, V8L 
3Y3, 34 pages, 1992. 

This occasional paper addresses major issues associated with the use of 
integrated learning systems in education, including do they promote learning, 
how is teaching effected in an ILS environment, implementation issues and 
conjectures on the future of ILS's. The report also presents a selected list 
of sources of evaluations of ILSs, brief descriptions of 5 ILS's (CCC, 
Classworks and ClassworksII, Podium, Jostens, and Wicat) and a 
recommended list of books and journals. 



22. Wilson, Alexander, The Invest Program: A Computer-based System for Adult 
Academic Upgrading. A Pilot Project . Centre for Learning Assistance and Research, 
Department of Education, Mount Allison University, Sackville, New Brunswick, EOA 
3C0, 32 pages, 1992. 

This study "was designed to det innine whether a heterogeneous group of adult 
learners could make significant gains in academic achievement over eleven weeks 
of training on a computer-based learning system (INVEST), and how such gains 
would compare to those associated with more traditional learning approaches." 
(page 1, Executive Summary). The study group was representative of a "typical" 
group seeking academic upgrading through the community college system in Nova 
Scotia. The instruments used to measure achievement were the Canadian Adult 
Ability Test (Level C) and the Test of Adult Basic Education (Level D). 
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CROSS-REFERENCING INDEX 



The chart which follows cross-references six integrated learning systems with the 
selected resources described in the annotated resources section of this appendix. The items 
cited provide descriptions of the systems, evaluations of the system when used with students 
and/or sites where a system has been used or is in use. Thus, someone interested in the 
Autoskill system would consult items 4, 8, 13, etc. for further information. (The number of 
citations is not intended to reflet the success or popularity of a system.) 



Autoskill 4, 8, 13, 17, 20 

CCC 1, 5, 8, 9, 14, 15, 17, 19, 20, 21 

Josten's INVEST 1, 8, 17, 20, 21, 22 

PALS 5, 7, 9, 19, 20 

Pathfinder 1, 2, 5, 6, 8, 9, 10, 12, 16, 19, 20, 

PLATO 1, 5, 7, 8, 9, 17, 19, 20 
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